Unifying Augmented Reality and Virtual Reality User Interfaces

This paper presents a unified user interface technology, using 3D interaction techniques, constructive solid geometry, and a glove based menuing system, known as Tinmith-Hand, to support mobile outdoor augmented reality applications and indoor virtual reality applications. Tinmith-Hand uses similar concepts for both domains so that AR and VR applications are consistent to use. The future goal of this user interface is to allow collaboration between outdoor AR and indoor VR systems. We use current AR and VR technology as a foundation for the user interface, and explain several new techniques that we have devised that allow us to develop applications that allow users to construct complex 3D models of objects in both indoor and outdoor settings. We demonstrate our user interface with the capture of a large house at a distance outdoors, and the creation of a simple building with street furniture at arms reach indoors.